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studies by Piaget and his collaborators, replications of Piaget's 
studiear, and related studies by other investigators, factors which 
influence performance on controlling variables tasks are delineated; 
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to control variables are analyzed. These studies demonstrate th«(t. 
training improves, logical thinking* under some conditions. It appears 
that students need to /Learn to recoonize and organize relevant * 
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ABSTRACT 



Research on the development of ability to control variables during 
adolescence Is reviewed. The f I rat section discusses studies 4>y Plaget. 
and his collaborators, replications of Plagets studies, and related stu- 
dies by other Investigators. Factors which Influence performance on, con 
trolling variables tasks are del I ne a ted; 1 the exlstance of Plagets stage 
of formal reasoning is considered. W the Second section, attempts to 
train students to Improve In ability to control variables are analyzed. 
These stud les demonstrate that training Improves logical thinking under 
some rondltipns. It appears that' Students need to leSTri to Tecognlzft 
and organize relevant Information In addition to learning a particular* 
strategy such as "make othe*r things equal* 11 Suggestions for future re- 
search and for development of educational programs are discussed. 
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Ability to control Variables or make "other things equ^l" Is of un- 
questionable Importance \p many everyday decisions. This was well IMus- 
trated In a luxury automobile commercial which argued ,r When I filled the 
gas tank of my old econbmy car and drove tt> Sacramento and bfcck, I always 
returned with a quarter of a tank. .Now when I fill my new luxury car and 
drive to Sacramento, I still return with a quarter of a tank/ 1 The concept 
of controlling variables Is Irv^fact a difficult one. Many adults have 
trouble recognizing uncontrolled variables In' complex situations like when 
selecting a car or interpreting Information about Insurance plans. Sclen- 
tlsts are aware of the need to control variables, but often discover that 

they have overlooked relevant variables. We will refer to ability to sep- 

-J 

arate variables or use the concept of "all other things being equal" as 
sclent i f Ic reasoning. 

Other writers have summarized earlier-work on scientific reasoning (Bias 
and Hoeffel, 197^; Lunzer, 1965; Peel, 1971; and Wallace; 1965) • While a 
recent review ofr adolescent reason Ing did not Include scientific reasoning 
(Nlemark, 1975) f recent research l^i^thls area has clarJfle^ some Important 
Issues for future work. 

* ft- 

This review fs concerned primarily with scientific reasoning between 
age 10 and 18. Primary emphasis Is placed on studies wher£ the relevant 

t 

variables are delineated for the subject rather than on studies where the 

i 

subject Is asked to discover variables for himself. Thus^ the primary task 
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In these studies is to separate and control the variables, not dete -rml ne what 
th« variables are. i. 

The most comprehensive theoretical framework to describe the development 

" " "* . 1 - >^ 

of scientific reasoning has been proposed by Inhelder and Piaget (1958)'. In 

.this paper Plaget's theory will be described , resul ts of both developmental 

and training studies wlll<be discussed in terms- of Piaget 1 s theory, and 

l ) 

educational implications in the area of scientific reasoning will be consl- 
dered. 



Placet's theory of Formal Operations 

■ * * * ' 

,i .* *« • 

/; . 

The f I rs-t-ma ior research and the most comprehensive work ori adolescent 

$ < - . 

reasoning wtaf conducted by Inhelder and Piaget (1958). They administered 

15 varied t^sks to Illustrate the change from what they call concrete to 
V ' • 

what they call formal operations. The change from concrete to formal op- 
erations Includes a change from reasoning about freal (or observed) events 
to reasoning about all f:he possible events In a given situation. At con- 
crete operations", the child reasons only about the spedlflc content of the 
problem. At formal operations, the d)Hd can separate the variables of the 

problem, and consider the possible values each varl e might have. Accord- 

* { 

Ing to Piaget, the formal operational child uses a System of propo? 1 1 lonal 
''logic (Inhelder and Piaget, I958, 293^303). 

Inhelder and Piaget (1958) postulate that these changes yln reasoning 
ability "depend on three principal factors: maturation of the nervoys sys- 
tem, experience acquired In Interaction with the physical environment*, and 
the Influence of the social milieu". (Inheldeij and Piaget, *p. 2-»3.).\lt 




should be noted that Plaget does not say these three factors are sufficient 
to. explain de ve I op men t , Frpro Infancy, the chlldVs mental development depends 
on experience with the world of objects and organisms, -'The social milieu 
Include*, the educational experiences of the child, Plaget notes "in general, 
learning is provokfed by situations - provoked by a psychological experimen- 
ter or by a teacher, with respect to some dladactlc point; or by an Internal 
situation. It (learning) Is -provoked In general as ^opposed to spontaneous. 
In addition, it Is a limited process - limited by a single problem or a 

• V * 

I 

single structure" (Plaget, \S6h,p. 8) . 

.Instruction will not "provoke" 'the learner unless related to the learn- 
er's current level of development. Thus, Plag'etlan training studies usually- 
Involve several pretests to select subjects at the appropriate Intellectual 

level. Additionally, Plaget has emphasized that Instruction must encourage 

« 

the learner to "decenter," The learner decenters by^ recognizing the Inval- 
idity of a part IcuVar explanation of a phenomena (or scheme In Plaget's ter- 
mlnology) and actively seeking a new scheme to explain his observation. It 
appears that "cognitive conflict," as devised by Sniedslund (1961), Is pre- 
ferred by Plaget and his collaborators; It Is the primary training technique 
used by Inhelder, Sinclair, and Bovet (1974). ' - 

Scientific Reasoning ., Inhelder and Plaget (1958) describe the develop- 
ment'of sclent I flcreasorxlrig (which they call separation of variables) In 

* ■ v . « 

conjunction with a number of experiments Including bending rods and pendu- 
lum. Looking specifically at the transition from concrete to formal thought, 
we w scy«y^the results ^oT^hes^ experiments** —> 

. The procedure for feach experiment Involves presenting the apparatus, 

4 

pointing out the variables under consideration and asking the child to find- 



out what makes one rod bend more than another (pending ^te) , or what influ- 
ences th^ period of a pendulum. 

In the bending rods experiment, students .are presented with slx^ rods 
which vary In. length, Width, shape of crossection (e.g., round or square) and 
material. They are shown weights whic^ cari be hung'from the rods and asked 
£o use the weights to find out which rod bends the rpost. Inhelder and 
Plaget found that concrete operational subjects can describe the results of 
their experiments, including the fact that two explanations are possible 
for the same outcome, but canj^pt use the "other things equal 11 scheme. Thus 
the subject, in describing what Plaget calls a serial ordering, might note 
lf Thls rod bends mc(re because it has more weight and lt\6 thinner than this 
rod 11 but could not set up a fair test to show that thick rods bend more 
than thin rods. Formal operational' subjects attempt to prove £omethlng<L^ 

(control variables) rather than describing the reality that th^y see. Sub- 

* • 
jects who have just reached the formal level only organ lz« proofs with ,1 all 

other things equal 11 in certain cas£s ^nd even then not for all of the reje- 

vant factors. By 1^ or 15 subjects, according to Inhplder and Plaget 

J ^ f 

(195&7, spontaneously organize proofs using the "a*l 1 other things equal" 

t 

scheme. « "* 

For pendulum a progression similar to that for bending rods Is found. 

• "* * , 

Concrete operational subjects may recognize that the length of the 'string 

Influences the period but, because they do not control other variables, they 

» 

conclude that other factors are Important as well (when. In fact, they are 
not). * At the beginning of the formal stage, subjects recogn Ize the advan- 
tages of controlled experiments, buKdcf not ^del Iberatel y set them up. In 

t 

fact, these subjects tend to vary two factors simultaneously and even to, 
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keep the factor undar investigation constant. Only at advanced fofn^al op- 
erations does the subject set up controlled experlnfcnts and discover which 
variable Is important . t 

In summary, the def Iplt Ions of concrete and formal thought proposed by 
Inhelder and Piaget require a reasonable amoont of explanation when applied, 
to actuaPexperlments \ Clearly the apparatus, number of variables f and type 
of variable influence whether subjects separate and control variables. The 

.experiments reported by Inhelder and Piaget (1958) do not demonstrate the 
exlstance of a general level of functioning since each experiment was tried 
wl tfy, dl fferent subjects. Additionally, one does not know how the general / 
population would perform since results are reported only for selected suj*- 

• Jects. ^) 

Replications of Piaget 's Work ^ 

Researchers using problems devised by Inhelder and Piaget^, have c6n- 
firmed Piaget's main stages in the development of logical thfnklng but have 

V 

% • 

also found that only a small proportion of adolescents and adults reach 

Piaget 1 * level* of formal operatlons t It is very difficult to compare the 

. . . " v 
data directly because the studies are not uniform In the age or ability of 

» ■ 
subject^, the experiments used to measure logical thinking, the experimental 

s X 

procedure, or the standards used to evaluate and categorize responses. The " 
diversity of studies Is both a tribute to and a Criticism of Piaget's work. 

m * 

• y * 

Piaget has certainly led others to conduct Interesting research: However, 

\ 

because he intended to describe , and Illustrate the develofynent -of cognitive 
abilities, Piaget's work Is imprecise, especially with regard to standardi- 
- zatton ^/categories. In this section we will describe studies establishing 



J 



1 



cross-cultural norms for tasks used by Inhelder and Piaget and studies Iq 1 
vestlgating {he relevance of the 16 b i nary -opcrat Ions to logical thinking. 

s Subjects who reach formal operations . As summarized by others (Bias! 
and Hoeffel, 197*0 , many researchers note that sma^l percentages of sub- 
jects reach formal operations f a$ defined by Pfaget. Dulit (1972) found 
that only 25-33% of normal adolescents, age 1 k to 17, and adulti, age -20 
to 55, qnd c»nly 60% of gifted 16 and 17 year olds exhibited formal opera- 
tions when they ^rled to solve some of Plaget's experiments. Otter re-' 



earchers who have repl learned Plaget's experiments generally report sjmllar 

rates (Jackson, 1965; Keasey, 1970; Lovell, >961). These studies, as well 

as Lunzer*s (1965), have al\so found that subjects who perform a task at one 

o \ 

level of thinking may well perform the next task at a more or less sophis- 
ticated level, even if the £Wo problems are logically similar. 

Looking at the effect of 'school I ng on sc I ent I f I c reason I ng , Be a rd ( 1 962 ) 
found^that .for 8 to 16 year old/ the level of logical thinking varied ex-* 
tenslvely between schools. Almost all subjects In one school failed to 
either treat the variables in the task Independen tjy , or to conclude that 

7 

* * V 

only one variable was significant- In another school, nearly all subjects 

over age 10 were able to separate the variables. Elsewhere, the subject? 

sHcwed the usual pattern of increasing success with age, Prevlaijs class- 
ic ■ 

rofrn experience appeared to play pn Important part In the ability to con- u 
trol variables. 

Mecke and Mecke (l971) _are the only Investigators who found a sample 
(of 15 year olds) who all appear to use formal operations. However, they 
determined that a subject used formal operations If he simply Usfed a sys- 
tematlc approach to eliminate the Irrelevant vart.ables* In Plaget's pendu- 

K 

lum problem. Inhelder and Pfaget (1958) consider ©.systematic approach 
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to be a necessary, but not sufficient condition for formal operations. A 
person at formal operations ntfst be-able to Investigate the variables and 
then explain how they Interact. Thus, Mecke and Me eke L s re search jdoes not _ 
necessarily contradict the other replication studies. It does empnaslze p 
the need^for clear, workable standards for further research on formal oper- 
ations. The task used, the subject's previous experience, and the defini- 
tion of formal operations all affect the proportion of subjects said to ex- 
hlbit forma K ope rat ions . % 

Criticism of P i age t 1 ^ propos i t ional logi c . ^{Several researchers have 
questioned the usefulness of Piaget^V system of propos I t Ional logic. Plaget's 
system Is based on 16 logical operations which he says characterize formal ' 
thought. ^ ■* . . 

£r(^s^ (1975) , In a comprehensive analysis of Pfaget's formulation, de-' 
monstrated that Piaget's interpretation of material implication is incon- 
sistent with standard propos 1 1 i6nal logic; he points ^out that Piage^s sysr 
tern Irfvites overgeneral izat ion and prohibits certain Inferences which are 
^accepted in standard propos i tional logic. Ennls also showed that the ability 
to "handle propos 1 1 ional logic 11 in Piaget's terms does not differentiate / 
young children from adolescents: some of the complex operations are jjsed 
correctly by 7 and 8 year olds, others are used poorly .by ^adolescents . He 

found no evfdence for a quantum jump ^during the chlld f s development In #. 

> 

ability to handle propos 1 1 ional logic* Relevant to our concern with sclen- 
tlflc reasoning, Ennis concludes f 'There appears to be no connection between 
isolating variables and possess I ng the combinatorial system (the 16 logical 
operations)". 
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Bynum, Thomas and We I tz~ (-1972) and Weitz, Bynum, Thomas, and Steiger 
(1973) f two of whom aVe logicians, reexamined Piagfet's protocols on one' ex- 
periment and replicated the same experiment with subjects up to 16 yeaKfcold, 
They found evidence for only 8 of the 16 logical operations In Piaget's work 
tend a maximum of 5 In their own protocols. They 'feel that 6 of the 16 oper- 

a 

atlons occur only in technical works on logic* O'sherson ( 1 9 7 '0 attempted 
to analyze I ndl vi dua ^protocol s for a series of related logical problems. 
The 16 operations were Ineffective In explaining errors In. solving- the pfp- 

blems. •'• • - £ ' ■ * \ 



* . *, 



Replications studies, tfien' have (I) IBeinpns t rated thaf 'focip^l .opera t fons«-. 

Is a less unitary trait than implied by Plagefe, (2)* questfonefjjWtfj* role of '"; 

Plaget's logical operations., (3) shown that only a small portion of adglts 

# '■ 

reach fc^\a\ operations., and {k) -emph^s ized the rteed for consistent stan- 
dards^ In evaluating formal thought. ' - . 

* ' * • ' -'. 

K Non-Plaget ian Studies of Scient i flc Reasoning- 

Several researchers have devised their own problems to Investigate for- 
mal operations. These studies illustrate the many variables that appear to 
Influence the Jevel of scientific reasoning demonstrated by a particular-* 
learner. They suggest re f nte rpretat Ions of PlagA^ijconcept Ion of scien- 
tific reasoning. \ * 

Level of Formal Operations In the Population » * 

Extending the work of those who replicated PlagetJ several studies have 
assessed the prevalence of formal operations* To determine how many people 
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regularly use f$rma I operations r Ybrp 1 ifs and Karplqs ( 13 70) * used the Island 

Problem: "There are four island^: Bird, SrieM , Fish, Bean. You can go by 

■ , * . •* * t > ^ , t , » _ . , . . 

plane between Bean and Fish, but^^^u can-t go between \'{J I rd_ and Snajl... 
1 Yotf cdn also go' between J*ean and ^^T^ ^ an Y ou 9° ( a ) between Fish yand Bird? 
,(b) between Fish and Snail? 11 They>found that only hO% of the group of 

physics teachers used formal, operations to solve thFs, problem. 

% ■* - - - 

Karplus and his coworkers also have devised problems concerning the 
correct use. of ratio and proportlpnal reasoning. They found that only 20% 
of a large sample of high school students used proportional reasoning con- 
slstently In a series *of logically similar problems. (Wollman and Karplus, 
197*0.' 

Wason and Johnson-Lai rd (1972) found a very low rate olF success among 
adults who tried to solve the Four Card problem: Four cards, showing re- 
spectlvely a 5, a 2, a B, and a U were presented. Subjects were Informed 
that all cards bear a letter on one side and a number on the other. The 
question was to decide which of the four cards needed to be turned qver to 
decide whether the statement "Every card with a vowel on one side has an 
even number on the other 11 was tYueV Only 5% of Intelligent adults will give 
the correct solution, the U and the* 5. However, Wason and Shaplrp (1971) 
found that performance Is Improved when thematic material Is used and Lunzer, 
Harrison, and Davey (1972) found that concrete content (full truck, empty 
truck, red, yellow, and the sentence M Every red truck Is full of coal 11 ) sub- 
stltuted for the arbitrary letters and numbers of the original problem led 
to greater success. Thus .the evidence for formal operations In the general 
populiatlbn Is low and the . f ami )J a af the material Influences performance. 
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Variables Relevant to Demons t'rat Ing Sclent 1 f I c Reasoning 
• Role of Experience . Karplus, Karplus, Form(sano, and Paulsen (1975) - \ 

* gave both proportional reasoning problems and controlling variables problems 
to 13 an<i 15 year olds In seven countries. About 25$ of the subjects used 

formal operations on proportional reasoning wh I Vc~ about 20$ used formal on 

—J f 

Controlling variables. The relative difficulty of the two tasks was not 

consistent from one country to another .and the two tasks were not. well cor- \ 

related over the entire population (Karplus, et al, 1975). They concluded 

that the program used for teaching science and mathematics In- each country 

Influenced the likelihood of demonstrating formal reasoning ability. These 

• *•;■■) f,ndln 9S parallel those of Love 11 (1961) for schools within England. A 

•* "' FamlUarlty and, number of variables . Li nn and Levi ne ( 1976) studied 

. r .. .. . . 

4 * T i three logically similar problems, each Involving different variables. They 

) -found thai* not all adolescents (age 11-16) exhlfljt formal operations when 

f trying to^stffve logical problems^ and that success fates vary depending on 

».. * . y • - ■' 

■ the f am 1.1 laxity of the variables. The key' to their tasks was to change one 
jyaVla v b|^yJtema4lcal ly while the other variables were held constant. One 

of the thY^^the Seed,s Problem, was presented orally 'as follows: 

te* , . • ••' «' 

/f ' "Suppose you had'^wo kinds of seeds, white radish seeds and red radish 
' " . • ' " 7\1^ ' ■■ > - \ 
^ jS^f|r e<,s ^ You want to see which kind will grow tallest In a week. You have 

Y , \> ,r two flower pots that are just the same, some soil, water, and fertilizer 

*\ ti. • .' ' ' ' 

•;^>tt|pets. What would you do? Hew" much soil would you put In the first pot? 

jhe other logically Si ml lar problems concerned rolling marbles on a ramp* 



; AvU (Ramp Task) and determining which wires were Involved In a cl rcul t, (CI rcul t 

V }; . • • . ■ * ' ^ 

^ ''r'ff TaSk ^* The Ramp and Clrcu,t Tasl < s w « re presented vt\th materials while the 

5 Seeds TJisk was presented orally without any materials. Over 90% of the 
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subjects could solve Seeds, but only pbout 10$ kf the same subjects could 

solve the Circuit, and only 1)0% of a second, group of subjects from the same 

classrooms could solve the . Ramp . Thus the familiarity of the Variables 

Influenced success on this task as wpuld be expected.** r 

Several Investigators have hypothesized that the number of variables 

In a given* task influences task di f f Iculty . Wozny and Cox (1975) 'found 

that the age interacted with the humber of variabiles in a particular task 

such that two variables tasks (like Balance Beam) were solved by most' 12- 

13 year olds, while tasks with multlple r interacting variables (like Float- 
er 

Ing and Sinking) were seldom solved, even by 16 and 17 year olds. Cas*e 

* 

^197^) reports similar relationships, for younger children between number of 
variables and the age of the child; 

Organization of the problem . Another area thaC has been investigated 
Is the role of the organization of the problem that the child must solve. 

Anderson (in Peel, 1970 found that secondary school girls used Imaginative 

y 

responses, the highest type in his study, to a greater degree when they 
could choose their response In a mu 1 1 1 pie choice format as opposed to an- 

■a 

swerlng an open-ended question/ Linn and Levlne (197&) found that*with a' 

multiple choice format, as opposed to a free format, more 12 to 16 year olds 

were able to design a properly controlled experiment to solve problems In 

j > 
physics. Wollman (in press) found a similar result with foOrth to twelfth 

graders. Hp examined the differences between three formats of the same 

question. In decreasing order of difficulty they wefe: 1- DevlseJ>oth 

f - . • < 

conditions of a simple experiment; 2- Complete the second condition of an 
experiment when the first is provided; 3~ Reject an Improperly controlled 
experiment when both conditions are provided. The second format Is very 



slmll.ar to Llnn and Levinc's or Ande rson 1 s -mu 1 1 1 pie choice format. Peel 
(1970 attribute^ Anderson's ffndlng to the "aducat I ve effect 11 of the'for- 

A f • 

mat. Linn and Levlne believe that the improved performance 'is due to the 
organization of the information. 



Amount of available information . A related question is the optimal 
amount of in format Idh provided to the child. Can there be too much inform- 



ation? The results are not completely consistent, at this . time. When Olson . 



(1966) limited three to nine year olds so that they bad to use information 
> 

one piece at a time, they developed more sophisticated conceptual strategies 



than when they were allowed free access to all available information. 

Using problems involvFng ratio and proportional reasoning, Karplus and 
his coworkers report a similar result wl th ( chMdreq^ln the fourth to twelfth 
grades. In their problem (Karplus and Peterson, 1970; Karplus and Karplus, 
1972) children were asked to determine thq size of a stick figure, Mr. Tall, 
In large paper clips, after they! had been shown the size of Mr. Small in . 
small and large paper clips, and the size of Mr. Tall In small paper-clips 



only. When the subjects were able to see both Mr. Tall and Mr. Small, many 



answers were based on a visual estimate of Mr. Tall. However, when the 



problem was rearranged so that the children were given the necessary In- 

s I 

^formation without agtually seeing Mr. Tall, they tried to use the available 



data In more sophisticated ways.* (Karplus, Karplus, and Wollman, 197^). 

\- 

«. 

Linn and Levlne (1976) found that performance was Impaired for 12 year 
oldS but not for 16 year bids when two different physics problems were 
organized so that the results were emphasized and the procedure was hidden 



from view/ The young subjects were more likely to make a decision based 

r 

only on the results that they saw. Many older children would not make a 



decision because they realized that they did not have all of the necessary 

• * 

t. 

Information. Both groups of subjects , however, performed similarly 9n the 

problem when the results, were not shown* Linn and Levlne note that. their 

V 

results are consistent with Plaget's characterization of the transition to 
formal operations as a chafige from considering only rea) events to reason- 
ing about jeal and all possible events in a. gl ven^s I tuat Ion . 

Peel (1971) reports on two studies that do not directly follow the trend 
of KarpUis, et al , or Linn and Levlne. In these studies, children vVere 
asked questions after they read passages, some with added Information and 
some <wl thout . In one project done by Brydon, there were no significant 
differences between groups on the/ f requencl e<r\of .ttiree levels of responses. 
In a second study, carried out by Hilton, a sllghFjy gr^ate r ^number of new 
pieces of Information and judgments emerged in the answers when the children 
read passages wt|h extra Information. Peel suggests that this Is'evldence 
for a readiness to ufee information when, children reach a certain intellec- 
tual maturity. 

There are a few important differences between the studies that may ex- 
plain the varied results. Peel reported on passage reading studies where 
the additional information was relevant the problem baling discussed. In 
Karplus' studies and Llnrr and Levlne's, the problems were not reading pas- 
sages, but Involved physical objects that were presented to the children; 
the additional Information provided was not relevant to the problem, It 
was superflous or even misleading. This Is an Important area for further 
research 'since one Important skill In problem solving Is the ability to 
separate the relevant from thjfe Irrelevant Infontiat ton. 

\ 
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' Lunzer has examined Piagef<s description of the transition from concrete 
to formal thought, and invest I gated/ft, us In g a problem he devised, lunzejr 
found that what he called °a>llUry to handle multiple Interacting systems" 

* f / - r 

more adequately descri bed/ thA/trans itlon from concrete to formal than thfc 

* 7- 

concepts suggested by Piage4. 

/"...,., ' 

t^unzer (1973) and his student, Plockirogton, have studied the switch 

•* 

problem. In this problem the subject is presented with a box which has one 
light and *» buttons to press. The subject was told that orte was a switch' 
which would cause the llgh£ to come on If it was off and v!c<} vers^a; one 
was neutral and would have no effect; one was an on button and this would 
cause the light to come . on If it was off but would have no effect If (twas 
on already; and the last was. an off button, the action of this being* tm 
exact opposite of the on* To help them keep track of events, subjects were 
offered 8 labels. These could be Used to tag any buttons they identified. 
The labels were on, off , change , neutral , on or change , on or neutral , off 
or change , off or .neutral . Lunzer found that, use of the last k labels was 
nonexistent at age 7, Infrequent at age 9, and almost universal at age 11. 
He hypothesizes that younger children do not use these labels. because of 
an Inability to imagine multlpleplnteracting systems. That Is, young chil- 
dren cannot accept that they only have sufficient evidence to decide that 

t 

a button is el ther off or change, since it must be one or the other. 
Summary of Status Studies of^Scientl flc Reasoning 

The studies of problems devised by others confirm the results of the 
i i 
replications of Placet's experiments. The level of formal operations Is 

reached by only a portion of the population of normal and even Intelligent 
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adolescents and adults. The sort^of reasoning ahllity Implied by full de- • 
velopmcnt of fprmal thought, thai Is the atfillty \o apply general principles - 

• 1 . J . • • - ■ /' 

of problem solving to feny problem, does not usually occur; Plaget (1972) / 

• • ■ • *« ■ - ; * 

has since acknowledged that, unlike the other major stages In cognitive" 
development , 1 1 appears that fu If development of the formal stage I s reached 
by only a segment of norma 1 adolescents and adults; Piogct does believe 
that al 1 adul ts deve lop forma 1 operat I ons I n some domal n . 

Detailed analysis of problems studied by Plaget has revealed a finer 
structure. Variables which Plaget did not mention have proven Important, 
such as the number of variables and the format of the questions. In seeking 
a logical structure independent of specific content*, Plaget has minimized 
these factors and emphasized his system of proportional logic (the 16 log- 
ical operations - ). However, it appears that this logical system Is difficult 
to recognize in'practice and inadequate for assessing progress In scientific 
reasoning (Ennls, 1975). 

Finally, Plaget has emphasized a change from reliance on concrete ex- 
perience' to use* of a. formal logical sys tem. Evidence for this sort of 
change Is lacking. Concrete apparatus appears to facilitate performance 
under some conditibns but to present interfering Information under others 
(Linn and Levine,' 1976; Karplus and Peterson , 1970) . Purely verbal prob- 
lems appear to be easier than concretely presented v p r ob lems In some cases 
but npt others (Linn and Levine, 1976; Peel, 1971). 

Plaget (1972) has also recently described formal operations as an Ideal 
congnltlve competertce. In Pldgetlan terms, It could be that people who 
are at the level of concrete operations' are not naturally exposed to- enough 
experiences of cognitive conflict. They have not^ had the qpportunlty to ac- 
comodate their cognitive structures to the hlQh level of formal operations. 

19 



They may find that corterpte operational thought Is more than adequate f^r 
dally living. 

Nevertheless, changes In scientific reasoning ability between' age 12 
and 16 have been documented (£inrv and Levlne f 1 976 ; Karplus and Peterson, 
•'970). A mpre complete* model for these charts Is needed. It may be that 

4 

people who do not use formal ope rat fona! reasoning for a particular problem 
have not hod the experiences necessary to devise methods to organize the 
fhf ormat Ion 'or to develop the capacities for handling this much Informat Ion. 
If the environment does not provide enough opportunities for the experiences, 
that are necessary Jo go behond concrete th6ught f can people be deliberately 
trained to think at a .h I gher * level ? The next section will deal with, this 
question. 

Training In Scientific Reasoning .,' 

From the evidence discussed above, It seems that Plaget's stage of 
formal operations Is a level of theoretical or potential competence, not 
of everyday performance. Additionally, the importance of the number and % 
.type of variables In the problem has been demonstrated. Some researchers 
hava attempted to train children so that their performance will approach 
formal thought; they have had some success In promoting scientific reason- 
Ing. Studies will be reported here concerning the promotion of more sophls- 
tic^ted thinking In adolescents. For examples of successful rtelatedwork 
with younger children, the reader sflfculd refer to Bryant and Trabasso (1971), 
Bryant (197M, Case (197M, Kohnstamm (19&3K and Inhelder, Sinclair, and 
Bovet (197*0. 
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Programs which teach scientific reasoning will be discussed by 'category: 
K * O) Individual Instruction; (2) Programed Instruction; .(3) Classroom 

instruction; and (*♦) Experiential sclen.ce.' 

Individual Instruction . One area of Invest I gat Ion -has been the use of 

cognitive conflict as a teaching device. Brcdderman (1973) used three 

tasks based on. the bending rods task from Inhejder and Plaget (1958) to train 

fifth and sixth graders to demonstrate whether the Independent variable 

changed with, any partlcula'r variable in the problem. They learned to con- 

trol all the Independent variables except the one under consideration, which 

had to be varied systematically. Bredderman was successful with most, but / 

not all of his subjects. He found. little difference between three methods 

* '. 

of Instruction: 1- reinforcement, where the results reinforce the Idea of 
controlling variables; 2-conf Met, where two or three variables were changed 
simultaneously, resulting In a misleading relation between one Independent 
variable and the dependent variable. The child had to resolve the conflict 
when the. presumed relationship was shown to be erroneous; 3-repet 1 1 Ion , 
where the problem to be solved was presented repeatedly. Bredderman, there- 
fore, found no advantage for cognitive conflict. 

Slegler, Llebert, and Llebert (1973) trained 10 and 11 year olds t6 con- 
^j^l variables and draw conclusions from their experiments. Children were 
trained to recognize that some variables do not Influence the outcome of 
experiments. Slegler^, et. al., found that a verbal explanation of the gen- - 
er»1 principles or the use of analogue problems w^ere equally effective in 
training their subjects to draw the correct conclusions about Plaget's f 
pendulum problem* In an extension of thls~sUidy, Siegler and Llebert (1975) 
Investigated the effect of conceptual framework and analogue problems or* a 

i 
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combinatorjal task. Jn this case,' they found that exposure to conceptual " 
framework plus analogue problem/ was successful In training both 10 and^l3 
year olds. The ^onceptiial fr%iework alone was effective for .13 yea^r olds 
but not 10 year olds. They observed that, for younger subjects, the effect 
of the analogue problems was to emphasize the need for written records. 
Olcfc^ subjects tended ^to make written records as a result of conceptual, 
framework training along. ^These two studies appear to suggest that train- 
ing which helps the, child organize the information In a given situation wj)ll 
Increase the likelihood of success on the problem. Additionally, 10 ycar 
olds need more concrete instruction in how to organize the Information than 
do 13 year olds. * 

Programmed Instruction . Seve-ral programmed' instruction procedures have- 
been used to promote logicajl thinking." Gray (reported In Peel, 1 9 7 1 ) in- 
cluded both cognitive conflict and strategies for sol ving .problems . Raven 
(1*97*0 used a short program providing problems and Strategies . He found 
that the program worked be^t when t^ie criterion questions matched those 
presented in the program. Although both Gray and Raven reported that their, 
programs enhanced mature thinking, they have not been completely successful 
In promoting generalization to new problems. 

The Productive Thinking Program was designed to train for generalized 
problem solving skills using self-paced pamphlet materials (Covington, 
Crutchfield, Davies^and Olton, 197*0 . In the program, non-school problems 
such as puzzles and mysteries are presented and the child Is taught skills' 
to analyze clues and find a solution. Evaluation of the program reveals 
that children make substantial gains in thinking skill as measured by a 
wide range of instruments from essays on poverty to solutions of new 
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niysterics (01 ton and Crutchf leld, * 1969) . The program authors Interpret 

these results as indicating that children can make far more effective use 

qf ithe capacities they already htfve when provided with a method for opera** 

t 

tidfcjlizlng their abilities. 

f Classroom procedures . Peel {1970 reports that one of his students used 
cognitive conflict as a device to iniprove the level of thinking." Peel's 
student ', Anderson, developed a program using the teaching method of instruc- 
tlo^^nd class discussion. The toplqs Jft judgment were: (1) Recognition 
of Inconsistencies, irrelevances, and pa rt 1 al I t les ♦ Example: Can you be 
obedient and clumsy at the same tlmetf (2) Reasoning from propos I tlonal 
statements to arrive at conditions under which statements might be true, 
false, or Inconclusive. (3) Looking for relevant Information. (k) Evoking 
and evaluating explanations. (5) The pitfalls of the Implications of the 
words M all M and "some 11 . (6) A full discussion of judgment problems. An 

example of a judgment problem is: 

■/ 

"Statement: In the Middle Ages most menNHved all their lives with- 
out being able to read. They built beautiful cathedrals, but did 
not know many of the ord-lcLary , everyday things which, every child of 
twelve knows nowadays. Every age builds upon the knowledge of those 
who went before. Question: Were the people of the fllddle Ages clever 
or stupid? How do you know?" " 

Hyram (1957) used Induction, gqlng from the specific problem to general 
principles, to Instruct \k year olds in several concepts of logical think- 
ing. Through guided class jpscusslon, his students arrived at Solutions to 
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a variety of logical- probl^s. After four months of regular discussion 
periods, the experimental group Improved In reasoning ability and logical 
thinking measured by problems similar to those used for draining. 

Lawson, -Blate, and ^^lanJ (1975) attempted to train 30 \}lgh school 
students to control variables. Students attended training sessions which - 

Involved both instruction and experience with apparatus* Students Improved 

r- 

In ability to do a problem taught In the program but made no gains lr^ ability 
to control variables when presented with a new problem. Although the train- 
ing was very short, students were told how to control variables. 

Case and Fry (1973) also ) /tral ned 15 high school studerf£s to control 
variables. Their program consisted of 12 forty minute training sessions 
which InVolved both written materials and apparatus. The major teaching 
tool was to ask students to think of counter explanations for particular 
events and then to think of ways to rule them out. Students "In the program 
performed s ign I f icfemt ly better than controls on a paper and pencil measure 
of controlling variables and criticizing experiments. Case and Fry used a 
considerably longer training procedure than Lawson. The pencil and paper 
test used by Case and Fry was very similar to exercises used In class. It 
Is not known how these subjects would perform on less familiar tasks. 

Expert en t lal Science . Another approach to teaching logical thinking 
has been the development of experiential science programs. LTnn and Thler 
(1975) conducted a large scale study of fifth graders who have studied 
science using part of the Science Curriculum Improvement Study (SCIS) pro- 
gram, which emphasizes spea'ratlng variables. In this program students: 1) 
try out their Ideas using apparatus; 2) are presented with a strategy, and 
3) try out the strategy with new apparatus. They fo^nd that .the logical 
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thinking ablfTt^of the fifth graders who studied the SCIS unit, exceeded 

controls and approach that of J a comparlsoh group of eighth graders. 

^ - . s~ 

Linn, Chen, and Thler (1975; In press}, report on the development of a 

Science Enrichment Center designed to Improve logical thinking. In this 



program students choose .apparatus and carry out personalized science pro- 
jects. They found that children who receive an Introduction to science* con 
cepts and then use the personalized materials make progress In learning to 
control variables, while In another study, children who did not have an 
Introduction before they Interacted with the materials made less progress 
In controlling variables. Combining the results of Linn, Chen, and Thler 
(1975) with those of Linn and Thler (1975) ,/lt seems clear that once chil- 
dren are alerted to the concept of control 1 1 ng variables in a setting where 
.the results of the experiments are not emphasized, they can apply these 
Ideas. Having been introduced to the Ide/i of controlling variables, ctfll- 
dren make progress in applying the Idea during free exploration of science 
experiments. Exploration without the Introduction Is less effective. A 
similar observation was made by Duckworth (197*0 while evaluating a materia 
centered science program.' 

Implications of Training Studies 

4 The great diversity of subjects, mode of Instruction, method of measur- 
ing learning, and length of training make It difficult to draw precise 
conclusions about the effect of training. These studies have all provided 
some combination of strategies and practical experience. It appears that 
strategies alone help students solve problems similar to those presented 

4 « ' 

■> 

In the training program (Raven, 1974; Hyram, 1957; Grey (In Peel), 1971; 
Olton and Crutchfleld* 1969; Lawson, et al, 1975; Case and Fry, 1973) and 



help older subjects more than younger subjects (Slec/Ier, t lebert, and 
Lleb„ert, V973) . Experience with apparatus appears to facilitate abiljty to 



solve new problems, especially when combined with strategies (Lltin and Thler 
1975;" Linn, Chen and Thler, In press; Linn, then and Tnle ^|*J?75; Slegler 
and Llebert, 1975). Cognitive conflict or related technj qAg^ have been 
used by many researchers to motivate students (Bredderman, 1973; Case and 
Pry, 1973; Pee), T970 but are not universally successful. ^ 

These findings suggested that programs which alm^to teach scientific 
reasoning will be most successful If they emphasize recognizing and organ- 
izing relevant information rather than If they simply emphasize a partlcu- 
*!| r strate 9y 5Uch as "make all other things equal" to control. 
e In this section we will discuss (l) relationship of taking studies 
to Plagetlan theory, (2) the relationship between cognl tl ve Conf 1 let and 
strategy Instruction, and (3)- the usefulness of task analysis' In training. 

Relationship of Training Studies to P lagetlan Theory. Collectively, 
these studies demonstrate that training Improves logical thinking under 
certain conditions. Plaget, commenting on the effectiveness of a classroom 
demonstration of controlling variables said, "It would be completely use- 
less, the'chlld must discover It for himself." (quoted by Hall , 1970). 
Plaget emphasizes the Importance of direct experience In learning and feels 
verbal Instructions are useless. 

It should be remembered that, Individually, the studies reported here 
are limited In scope. In general, the training studies have only fostered 
logical thinking In one relatively narrow area of problem solving. They , 
have not .attempted to demonstrate that the subjects' newly acquired skills 
have generalized to other related areas. - Some writers have asserted that 



logical abilities of a formal operational c*M1d should be evident to npn 
scientific fields and even in situations calling for moral judgments' 
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(Kohl berg and Gil 11 gan, 1971). Others (Bias! sHoeffel, 1975) fee.W tfiat , 
In the area of personality development, the problems encountered duftfm 
adolescence lend themselves to using concrete structures rather than |-^ial 
structures. It Is not known whether these training programs have actW^V^ ' % 
disrupted Plaget's sequence of stages, or whether they have only encourade;^^ 
or accelerated their appearance. 




The most successful studies have not totally rejected Plaget's Idea v 
* about the growth of logical thinking. Instead, they have condenied the pr^\';^^^; 
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cess by usfng the Fdea of cognitive conflict In a systematic fashion. By\^ 

presenting selected experiments that forced the subjects to Incorporate * 

* 

Information that conflicted with their previous Ideas, they were led to 
higher levels of thinking. The goal of the final levels, was usual Ty the 



development of powerful, generalized principles that could be applied to 
,. ... t 

a broad range of problems. J 

■-\ Cognitive Conflict vs. Teaching Strategies , Both cognitive conflict 

'4&and providing simple strategies for solving problems have been used to 

describe procedures which enhance scientific reasoning ability. What are 

the differences In these approaches? Bryant (1974) assumes that problem 

solvers change their solution strategy when presented wlth^ complex as op- 

posed to simple problems. Bryant argues, for Instance, that Very young 

children can make trfcltlve Inferences and that^thls ability ''exists" In 

these and older children, but may not be applied to appropriate problems. 

Thus, the job of the educator Is not to teach trans It I ve' Inference, but to 

teach strategies for s ImpT I fylng problems to a level where-the appropriate- 

... . . v • . \ r 

nass of transitive inference will be. recogn I zed and can be applied. 
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Placet, on the other hand, assumes that failure of a transitive reason- 
ing problem reveals that the child does not have a generalized strategy. 
Followers of "Piaget have tried teaching new strategies by inducing con- 
flict. If the learner sees that an approach leads to obviously false con- 
elusions, the learner will seek a new strategy and may select the appro- 
priate one. 

Clearly, whether the problem solver has an Imprecise strategy or has 
difficulty simplifying the problem to fit a strategy, the .result will be 
failure of the problem. Strategies can be learned, for simple problems. 

« 

% Once the strategy Is learned, procedures for simplification of complex prob- 
lems to fit the strategy can be developed. It might be that generalized '- 
strategies for s I mp 1 i fy Ing problems are developed by successful learners. ^ 

Usefulness of^Task Analysis In Training . Gagne (1970) has pointed out 
the usefulness of diagramming learning hierarchies for solutions to problems 

* 

By attempting to diagram a learning hierarchy *ased on s Impl I f I cat Ion stra- 
tegies and conflict; one could set up Intermediate steps In the solution 
process. Using this approach It might be possible to better assess the 
learning problems of Individual* chl Idren and tp determine whether Conflict 
training or strategy learning would be appropriate. 

Case (1975) has noted that Gagne's system could be expanded to Include 
analyzing the learning task from the learners point of view. This view Is 
congruent with the suggest ion, that learning problems of Individual children 

'4 

be considered. 

Task analysis of problems presented to children has both theoretical 
and practical significance. Such an analysis should help reveal the re la- 
tlve Importance of strategy learning and cognitive conflict In problem 
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solvtng. A task analysis should also supply educators with In format 1 8rT con- 

* - * 

corning appropriate methods for Instruction, 

The task analysis of a controlling variables problem carried out by Linn 
and Levlne (1976) I l^us t rates the value of the approach. Essentially, as 
discussed above , they found that three questions about the same variables 
fn dffrc rent formats were differentially related to age. Comparing familiar 
and unfaml 1 lar variables, Linn and Levlne found that the familiarity dimen- 
sion Interacted with the format of the question. Linn and Levlne note that 
Plaget's statements about the change from the M real M to the "possible 11 are 
congruent with their results, but do not lead to Imp! Icat Ions ¥or Instruction. 
They suggest that a strategy for simplifying Information In a question would 
facilitate performance. 

\ Summary and* Educational Implications 



In reviewing studies of scientific reasoning, we noted that Changes do ' 
take place during adolescence but that these changes are not as complete 
as suggested by Plaget's description of formal thought and are Influenced 
by factors not emphas Ized by Inhelder and Plage t (1958):. Researchers In- 
terested In clarifying the development of scientific reasoning In adole- 
scence need to be aware of the following factors which appear to Influence 
performance: (1) Nurtiber of varlaWfes to be considered, (2) Familiarity of 
the variables to th^. subject, (3) Previous school experience with variables, 
(k) Method of presenting Information about the task (e.g., results Included), 
(5) Procedure fbr Interacting with the apparatus (e.g., free or constrained), 

and (6) Subject, matter of the problem (e.g., physics vs. btplogy, consumer 

i 

affal rs or logic) . 

v ; 2.9 . • 
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Research on adolescent scientific reasoning reveals several Important 
findings for Instruction: 

(1) The most critical Information for educators Is thatonly a small 
number of adolescents can effectively control variables In fam- 
iliar si tuat Ions. 

(2) Since relatively few adolescents reach formal operations, concrete 
experience is a valuable aid to learning at all stages of adole- 
scent reasoning. Futu re - researchers need to be concerned wltK the 
question of the role of concrete experience In learning. At the 

r , 

moment It appears that concrete ^experl ence Is necessary but not 
sufficient. Research such as that of Slgler and Llebert (1975) or 
llnn t Chen, and Thfer (In pre^s^, whfch compare various Instructional 
•modes Is needed to clarify this question and assist educators In 
planning programs, 

f 

(3) In the current situation where definitive answers do not; exist, pro- 
j grams which offer the learner a choice of mode of learning or pro- 
vide several approaches for teaching the same principles are pro- 
bably more useful than programs motivated by a particular theoiiy* 

It may be possible to provide a wide range of choices and assume 
that the learners will choose experiences reasonably congruent with 
their abilities. 
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